Image compression usable with animated images

ABSTRACT

To compress an image, each pixel is considered. The color of each pixel, represented as an index into a color palette, is compared with the color of the pixel&#39;s upper and left neighbors and encoded to an entry in the color palette. A probability distribution is updated based on the colors of the pixel and its left and upper neighbors. Once all pixels are encoded, the color palette is optimized using the probability distribution, and the indices into the color palette for the pixels are compressed. In the preferred embodiment, the compression is achieved using a single pass over the pixels in the image, and the probability distribution is updated dynamically as each pixel is compressed.

RELATED APPLICATION DATA

This application claims priority from U.S. Provisional PatentApplication Ser. No. 60/178,482, titled “NETWORK SEARCHING WITH SCREENSNAPSHOT SEARCH RESULTS,” filed Jan. 27, 2000, U.S. Provisional PatentApplication Ser. No. 60/199,781, titled “NETWORK SEARCHING WITH SCREENSNAPSHOT SEARCH RESULTS AND RICH CONTENT FILES WITH SELF-CONTAINEDVIEWER,” filed Apr. 26, 2000, and U.S. Provisional Patent ApplicationSer. No. 60/230,043, titled “IMAGE COMPRESSION TECHNIQUE FOR USE WITHANIMATED IMAGE FILES,” filed Sep. 1, 2000.

A portion of the disclosure of this patent document contains materialthat is subject to copyright protection. The copyright owner has noobjection to the facsimile reproduction by anyone of the patent documentor the patent disclosure, as it appears in the Patent and TrademarkOffice patent file or records, but otherwise reserves all copyrightrights whatsoever.

FIELD OF THE INVENTION

This invention pertains to compression techniques on a computer, andmore particularly to a lossless compression technique usable withdigital color images, including animated images.

BACKGROUND OF THE INVENTION

File compression technology has recently experienced a resurgence.Originally, file compression was necessary because disk space waslimited. To maximize the number of files that could be stored on a disk,it was occasionally necessary to compress files. More recently, harddisk space has become very cheap, and users have been able to storemassive quantities of data. The need for compression to save disk spacehas diminished.

At the same time that disk space has become cheap, however, anotherbottleneck has arisen: throughput. Although people enjoy the freedom theInternet gives them, in terms of research and file transfer, most peopleuse limited throughput connections to the Internet. For example, at 56Kbps, to transfer a 1 MB file takes approximately 2 minutes and 26seconds. A single image file, storing a 1024×768 image in true color,taking up 2.25 MB of space, requires 5 and a half minutes to download.Multiply that time by several files, and the transfer times become aserious problem.

One technique used to reduce the size of the file is to limit the numberof colors used in the image. There are two reasons why including a largenumber of colors in an image is impractical or unnecessary. First, thecomputer hardware on which the image is displayed (i.e., the monitor andvideo card) might be limited in the number of colors that can bedisplayed at one time. Second, the human eye is limited in the number ofcolors it can distinguish when looking at an image. To address theseconcerns, a typical image uses a color palette, which includes either asubset of the colors in the image or approximations of the colors in theimage. The number of entries in the color palette determines the numberof different colors that occur in the image. In the preferred embodimentof the invention, the color palette of the image includes 256 colors,but a person skilled in the art will recognize that this number canvary. The Median Cut or a similar algorithm can be used to select thecolors stored in the color palette. The specifics of how the colors areselected for the color palette is not relevant to the invention and willnot be discussed here.

Using a color palette begins the process of compressing the image. Forexample, if the image is stored using 24-bit color, it takes three bytesto store the color for each pixel. If only 256 colors are used andstored in the color palette, the color for each pixel can be representedusing only one byte: the index into the color palette. This reduces thesize of the image file by two thirds.

Further compression is also possible. For example, instead of using onebyte to identify the index into the color palette for a pixel, a Huffmancoding can be applied to the indices into the color palette for thepixels. In a Huffman coding, the frequencies for each symbol (in thiscase, the different colors in the color palette) in the message (in thiscase, the image) are calculated. The entire image is scanned, and thenumber of times each color is counted is scanned. The frequency for eachcolor can then be determined by dividing the number of occurrences ofeach color by the total number of pixels in the image.

Once the frequencies of each symbol in the message are known, a Huffmantree can be constructed. FIG. 10 shows the construction of the Huffmantree. In FIG. 10, there are four symbols, “A,” “B,” “C,” and “D,” withthe respective frequencies of 0.10, 0.20, 0.30, and 0.40. Thefrequencies start out as leaves 1005, 1010, 1015, and 1020 in ato-be-constructed tree. The two smallest frequencies are assigned acommon parent node in the tree, and the parent node is assigned afrequency equal to the sum of its children. In FIG. 10, the two smallestfrequencies are 0.10 and 0.20, which combine to a parent node frequencyof 0.30. The process then repeats, using the parent node's frequency inplace of its two children, until only a single (root) node remains.

Once the Huffman tree is constructed, the two children of each parentnode are assigned a “0” or a “1”, depending on whether they are a “left”or a “right” branch from the parent node. (A person skilled in the artwill recognize that the determination of which branch is “left” andwhich is “right” is arbitrary.) The Huffman coding for each symbol isthe sequence of branches from the root node of the Huffman tree to theleaf for that symbol. For example, the Huffman coding for symbol “D” is“1”, whereas the Huffman coding for symbol “B” is “001.”

The advantage of Huffman coding is that symbols that occur frequentlyare assigned shorter codes than symbols that occur infrequently. As canbe seen from the example of FIG. 10, the symbol “D” occurs 40% of thetime in the message, whereas symbol “B” occurs only 20% of the time.Because there are more occurrences of the symbol “D,” a shorter code forthe symbol “D” as compared with symbol “B” will result in a shortermessage.

There are two problems with using a Huffman coding as described above.First, the image must be scanned twice: once to determine the Huffmancodes, and once to compress the image. Huffman coding cannot bedetermined while scanning the image. Second, because the coding isnecessary to determine the appropriate color for each pixel, the codingmust be stored in the compressed image file.

Other techniques exist to compress images: for example JPEG (JointPhotographic Expert Group) and MPEG (Motion Picture Expert Group)compression. These techniques allow for fast compression anddecompression. But JPEG and MPEG compression techniques are lossy: thatis, they achieve high fast compression rates by losing information.Typically, the loss is imperceptible: for example, with still imagescompressed using JPEG compression, the lost information is typicallybelow the level of perception of the human eye. But often, the usercannot afford to lose information from the image that needs to becompressed. For such images, JPEG and MPEG compression is useless.

Accordingly, a need remains for a way to compress digital images thataddresses these and other problems associated with the prior art.

SUMMARY OF THE INVENTION BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A shows a computer system designed to compress an image fileaccording to an embodiment of the invention.

FIG. 1B shows a computer system designed to decompress an image fileaccording to an embodiment of the invention.

FIG. 1C shows two computers as shown in FIGS. 1A and 1B connected via anetwork for transferring a compressed image file.

FIG. 2 shows a close-up of an image file being compressed by thecomputer system of FIG. 1A.

FIG. 3 shows five probability models used to compress the image of FIG.2 on the computer system of FIG. 1A.

FIG. 4A shows the image file of FIG. 2 being divided into boxes forcompression on the computer system of FIG. 1A.

FIG. 4B shows an image file divided into two different tessellations onthe computer system of FIG. 1A for compression.

FIGS. 5A and 5B show an animated image file being analyzed to determinea distance frame to compress the animated image file on the computersystem of FIG. 1A.

FIGS. 6A and 6B show the procedure used to compress the image file ofFIG. 2 on the computer system of FIG. 1A.

FIG. 7 shows the procedure used to divide the image of FIG. 2 into boxesfor compression on the computer system of FIG. 1A.

FIG. 8 shows a structure for an image file compressed according to thepreferred embodiment of the invention.

FIGS. 9A and 9B show the procedure used to decompress the image file ofFIG. 2 on the computer system of FIG. 1A.

FIG. 10 shows a Huffman coding tree according to the prior art.

Appendix A shows an implementation of the compression algorithmdescribed herein, implemented in the C programming language andincluding comments.

DETAILED DESCRIPTION

FIG. 1A shows a computer system 105 in accordance with the invention.Computer system 105 includes a computer 110, a monitor 115, a keyboard120, and a mouse 125. Computer 110 includes hardware components, such asa processor 105, a memory 130, and a branch prediction apparatus (notshown). Computer system 105 may also include other equipment not shownin FIG. 1A, for example, other input/output equipment or a printer.

Computer system 105 stores image 130. Typically, image 130 is loadedinto the memory of computer system 105. A person skilled in the art willrecognize that image 130 can be accessed in various ways: for example,over a network connection or from a scanner (not shown). Image 130includes color palette 135, which specifies the colors used to displayimage 130.

Software 140 is installed in computer system 105. Software 140 includesprobability set 145, update module 150, compressor 155, distance framegenerator 160, block locator 165, and size estimator 170. Probabilityset 145 includes at least one model, and can possibly include multiplemodels, which can be used to predict the likelihood of the next pixelhaving a color that matches its left or upper neighbors. Update module150 is responsible for updating probability set 145 based on the actualcolors of the pixel and its left and upper neighbors. Update module 150can also select a different model from probability set 145, if needed.(Probability set 145 and update module 150 will be discussed furtherwith reference to FIG. 3, below.) Compressor 155 is responsible forencoding/decoding the color of the current pixel. Distance framegenerator 160 is responsible for generating distance frames between twoframes of an animated image file. (Distance frame generator 160 is notused when an image file is static.) Block locator 165 is responsible forlocating blocks within image 130 that are different from the backgroundcolor of the image. Size estimator 170 is responsible for estimating thesize of compressed image file 175 using different blocks located byblock locator 165.

Compressor 155 uses the size estimations calculated by size estimator170 to select the tessellation of the image (or the image frame) thatwill produce the smallest file size. Compressor 155 then uses compresseseach block in the tessellation with the smallest file size for the image(or image frame). This compression uses the probability values inprobability set 145.

In FIG. 1B, computer system 105 includes decompressor 180. Decompressor180 is responsible for decompressing compressed image file 175. Sincethe contents of compressed image file 175 contain all the data of theimage, decompressor 180 can completely reconstruct original image file130 from compressed image file 175.

FIG. 1C shows two computers connected via a network for transferring acompressed image file. In FIG. 1C, computer system 105 stores acompressed image file. Other computer systems, such as computer systems185A, 185B, and 185C, are like computer system 105 and can make requestsfor the image file from computer system 105. The compressed image fileis then transferred over network 190 to the requesting computer, whichcan then decompress compressed image file 175 to reproduce originalimage file 130.

A person skilled in the art will recognize that, although a network isshown in FIG. 1C, there are other ways of transferring the compressedimage file from computer system 105 to computer systems 185A, 185B, and185C. For example, the compressed image file can be placed on acomputer-readable medium, such as a floppy disk or compact disc (CD),and physically transferred to the destination computer system. Inaddition, there are many different types of networks over which thecompressed image file can be transferred: for example, local areanetworks (LANs), wide-area networks (WANs), a global internetwork,wireless networks, and so on.

FIG. 2 shows a close-up of image file 130 being compressed by thecomputer system of FIG. 1A. In FIG. 2, image 130 includes a rectangulararray of pixels. Close-up section 205 shows some of the pixels in image130 more closely. For example, pixel 210 has left neighbor 215 and upperneighbor 220. Left neighbor 215 and upper neighbor 220 have the samecolor (represented by the cross-hatch pattern), and pixel 210 has thesame color. In contrast, pixel 225 has the same color as its upperneighbor 230, but a different color than its left neighbor 210. Pixel235 has a color different than both its left neighbor 225 and its upperneighbor 240. A person skilled in the art will recognize othercombinations of colors for a given pixel and its respective left andupper neighbors.

FIG. 3 shows why it matters what the colors of the current pixel and itsleft and upper neighbors are. FIG. 3 shows a probability set whichincludes five probability models used to compress the image of FIG. 2 onthe computer system of FIG. 1A. In FIG. 3, there are five probabilitymodels 305, 310, 315, 320, and 325, but any number of models can beused. Because the details of each are similar, only the details ofprobability model 305 are shown in detail. Each of the probabilities305-1, 305-2, 305-3, 305-4, and 305-5 reflects a combination of thecolors of the current pixel and its left and upper neighbors; theprobabilities are determined by the ratio of the individual probabilityrelative to the sum of all probabilities with the same colorcombinations for the left and upper neighbors. Thus, probabilities 305-1and 305-2 are determined relative to all pixels whose left and upperneighbors have the same color, and probabilities 305-3, 305-4, and 305-5are determined relative to all pixels whose left and upper neighborshave different colors. Probability 305-1 reflects the probability thatthe current pixel has the same color as both its left and upperneighbors (10/11). Probability 305-2 reflects the probability that thecurrent pixel has a different color than the left and upper neighbors,which have the same color (1/11). Probability 305-3 reflects theprobability that the current pixel has the same color as its leftneighbor but a different color from its upper neighbor (10/21).Probability 305-4 reflects the probability that the current pixel hasthe same color as its upper neighbor but a different color from its leftneighbor (10/21). Probability 305-5 reflects the probability that thecurrent pixel has a different color than either its left or upperneighbors, which have different colors (1/21).

The values shown for probabilities 305-1, 305-2, 305-3, 305-4, and 305-5are the initial probabilities for each color combination, and areupdated as the image is compressed. For example, probabilities 305-1 and305-2 define the probabilities that the current pixel has the same coloras its left and upper neighbors given that the left and upper neighborshave the same color. For example, given that the left and upperneighbors have the same color, it is initially assumed that the currentpixel is ten times as likely as not to have the same color as its leftand upper neighbors. As the model is updated, this probability changes.

It is important to distinguish between the terms “probability set,”“probability model,” and “probability.” “Probability set” refers to theset of all probability models used in the compression. There can be oneor more probability models in each probability set; typically, therewill be only one probability set used to compress a single image file.“Probability model” refers to the set of probabilities (which can alsobe called probability values) used in a single probability model.Typically, each probability model will include probabilities for similarconditions. “Probability” refers to the individual probability of agiven condition happening in a single probability model. So, in FIG. 3,probability set 145 includes five probability models 305, 310, 315, 320,and 325, and each probability model (such as probability model 305)includes five probabilities 305-1, 305-2, 305-3, 305-4, and 305-5, shownas initial relative values 10, 1, 10, 10, and 1, respectively.

The different probability models allow for additional history to be usedin predicting the current pixel's color. In general, the behavior of thenext pixel will be similar to the behavior of other pixels that havesimilar color matches between the current pixel and its left and upperneighbors. Thus, if the current pixel has the same color as its upperneighbor but a different color from its left neighbor, it is expectedthat the next pixel will be colored relatively similarly to other pixelswhose previous pixel has the same color as its upper neighbor but adifferent color from its left neighbor.

Just as the colors of the left and upper neighbors select whichprobability to use within a probability model, the colors of the leftand upper neighbors can be used to select the next probability set touse. For example, given that the left and upper neighbors of the currentpixel are the same color and the current pixel has the same color,probability set 305 can be used in determining the probability of thenext pixel's color. Or, given that the left and upper neighbors of thecurrent pixel have different colors and the current pixel has the samecolor as the upper neighbor, probability set 320 can be used indetermining the probability of the next pixel's color. By changingprobability models, each probability model tends to become focused onone probability value, which improves compression. In the preferredembodiment, one model is used after one of the five probabilitiesoccurs: that is, probability model 305 is used after the current pixelhas the same color as both its left and upper neighbors, probabilitymodel 310 is used after the left and upper neighbors have the samecolor, but the current pixel has a different color, probability model315 is used after the left and upper neighbors have different colors,and the current pixel has the same color as its left neighbor,probability model 320 is used after the left and upper neighbors havedifferent colors, and the current pixel has the same color as its upperneighbor, and probability model 325 is used after the left and upperneighbors have different colors, and the current pixel has a differentcolor than either its left or upper neighbor.

Update module 150 from FIG. 1 updates the individual probabilities ofthe probability models in the probability set. For example, assume thatprobability model 305 is currently being used, and the current pixel hasthe same color as its left neighbor, but not its upper neighbor. In thiscase, update module 150 updates probability 305-3. Update module 150 canalso select the probability model to use with the next pixel: in thiscase, probability model 315.

FIG. 4A shows the image file of FIG. 2 being divided into boxes forcompression on the computer system of FIG. 1A. In the example shown inFIG. 4A, image 130 includes two curved shapes and a rectangle. First,image 130 is scanned to determine a background color. This is done byanalyzing the border of the image. If there is a color that predominatesthe border of the image, this color is selected as the background color.Then, to divide image 130 into boxes, the image is scanned to determinevertical stripes in which pixels appear that differ from the backgroundcolor. Two such stripes are present in FIG. 4A: stripe 405 and stripe410. Each stripe is then divided into boxes, such that each horizontalrow of pixels in the box includes at least one pixel with a colordifferent from the background color. This forms boxes 415 and 420. Boxes415 and 420 can then be compressed individually, with the remainingpixels in image 130 colored with the background color.

A person skilled in the art will recognize that, although the stripeswere first located vertically and the boxes then formed horizontally,this is not the only way the boxes can be formed. For example,horizontal stripes can be formed first, and then boxes by analyzing thehorizontal stripes. In addition, although there are advantages torectangular image shapes, the boxes do not have to be rectangular inshape. Indeed, any shape can be used to define a box. The advantage ofthe rectangle is its simplistic definition: only a starting point anddimensions are required to define a rectangular box.

In the preferred embodiment, boxes are located by analyzing the imagefor stripes both horizontally and vertically. The size of the compressedfile is estimated using both horizontal and vertical striping, and thestriping that produces the smaller file size is selected. Thiscomparison is discussed further below with reference to FIG. 4B.

FIG. 4B shows an image divided into two different tessellations on thecomputer system of FIG. 1A for compression. In FIG. 4B, image 425includes one L-shaped object 430. (Object 430 can be thought of as anapproximation of the elliptical objects in box 415 of FIG. 4A.) Althoughobject 430 could be enclosed by box 432, there are other ways to divideimage 425. Instead, image 425 can be tessellated into rectangular boxes,and each box compressed separately. Two different tessellations areshown in images 435 and 440, respectively showing the boxes found whenthe first stripes are located vertically and horizontally. (The shadingin images 435 and 440 are only used to show the different tessellations,and are not meant to represent different colors.) Depending on whichtessellation from in images 435 and 440 are selected, either boxes 445-1and 445-2, or boxes 450-1 and 450-2, can be compressed according to thepreferred embodiment of the invention.

The tessellations shown in images 435 and 440 may result in a smallerfile size for the compressed image file. For example, if object 430includes only one color (ignore for the moment dot 455), compressing box432 would include two colors, and compression according to the preferredembodiment of the invention would be necessary. On the other hand, boxes445-1 and 445-2, or boxes 450-1 and 450-2, would each include only onecolor, and thus can be specified with only a location, size, and color.

Although when dot 455 is ignored the two tessellations would result incompressed files of identical size, including dot 455 can make adifference. The box that includes dot 455 is compressed using thepreferred embodiment of the invention, rather than just storing alocation, size, and color. When dot 455 is included, image 435 has anadvantage, since box 445-2, which includes dot 455, is smaller than box450-2 in image 440, and hence box 445-2 would compress to a smaller filesize.

FIGS. 5A and 5B show an animated image file being analyzed to determinea distance frame to compress an animated image file on the computersystem of FIG. 1A. In FIG. 5A, image frames 130-1 and 130-2 areconsecutive frames from the animated image file. Although each frame canbe analyzed as described above with reference to FIG. 4A and compressed,this approach might not result in the best possible compression. Forexample, consider the change between image frames 130-1 and 130-2.Careful inspection will reveal that the only change between image frames130-1 and 130-2 is that rectangle 505 has moved downward slightly, asindicated by arrow 507. By “subtracting” the image frame 130-1 fromimage frame 130-2, a distance frame can be computed. This difference isshown in FIG. 5B as distance frame 130-3. Box 510 has changed from thecolor of rectangle 505 to the background color of the animated image,and box 515 has changed from the background color to the color ofrectangle 515. It should be apparent that compressing boxes 510 and 515of distance frame 130-3 would require less space than compressing imageframe 130-2. When it becomes necessary to display image frame 130-2,distance frame 130-3 can be decoded, and only the pixels that havechanged from image frame 130-1 need to be redisplayed.

Where animated images are used, the preferred embodiment analyzes eachframe four different ways. First, as discussed above, the size of eachcompressed frame is estimated using horizontal and vertical striping.Then the distance frame between the current frame and the previous frameof the animated image is calculated, and size estimations are calculatedusing horizontal and vertical striping on the distance frame.

FIGS. 6A and 6B show the procedure used to compress the image file ofFIG. 2 on the computer system of FIG. 1A. At step 605, the color of thecurrent pixel is compared with the colors of the current pixel's leftand upper neighbors. Depending on the colors of the current pixel andits left and upper neighbors, the appropriate probability value (and, ifnecessary, the color of the current pixel) is encoded at the applicableone of steps 610, 615, 620, 625, or 630 (FIG. 6B). At step 635 (FIG. 6A)the model is updated. If multiple models are being used, at step 640 anew model is selected. If there are pixels remaining to be compressed,the procedure returns to step 605 for another pixel. Otherwise, at step645, the indices of the color palette entries are compressed accordingto the model(s).

The encoding performed at the applicable one of steps 610, 615, 620,625, or 630 is performed using a range encoder. The range encoder is avariation of an arithmetic coder: the difference between an arithmeticcoder and a range coder are primarily technical in nature and thedistinction need not be explained here. Arithmetic coding operates byassigning each possible symbol a range of probability values between 0%and 100%. Initially, the arithmetic coding covers the entire range from0% to 100%. Then, as an individual symbol is encountered, the range isnarrowed to include only the probabilities covered by that individualsymbol. The process is then repeated, applied to the sub-rangeestablished by the previous symbol.

An example can help to clarify how the compression works, using a rangecoder with probability already known: i.e., a static model. Consider themessage “DCDACBDCDB.” The letter “A” occurs once, for a probability of10%. Similarly, the letters “B,” “C,” and “D” have probabilities 20%,30%, and 40%, respectively. The arithmetic coder can assign to theletter “A” all values between 0.0 (0%) and 0.1 (10%). Similarly, theletter “B” can be assigned all values between 0.1 and 0.3, the letter“C” values between 0.3 and 0.6, and the letter “D” values between 0.6and 1.0. (The border between ranges for adjacent symbols can be dealtwith a technical fix: for example, each range is defined to be exclusiveof its upper limit, and so the value 0.1 is assigned only to the letter“B.” A corollary of this definition is that the value 1.0 is excluded. Aperson skilled in the art will also recognize other ways this problemcan be addressed.)

When the range encoder encounters the first letter (“D”), it narrows therange of acceptable encodings from 0.0 through 1.0 to 0.6 through 1.0(since the letter “D” is assigned the range 0.6 to 1.0). Since thesecond letter is “C,” the range is further narrowed to 0.72 through0.84. This range is calculated by multiplying the range for the newsymbol (“C”) by the size of the range calculated so far (0.4, whichgives the relative range of 0.12 through 0.24), and adding the resultingvalues to the low end of the previous range (resulting in 0.72 through0.84). When the next symbol (“D”) is encountered, the range is narrowedto 0.792 through 0.84. Table 1 shows the range of acceptable encodingsafter each symbol in the message is encountered. TABLE 1 Message Range D0.6 though 1.0 DC 0.72 though 0.84 DCD 0.792 though 0.84 DCDA 0.792though 0.7968 DCDAC 0.79344 though 0.79488 DCDACB 0.793584 though0.793872 DCDACBD 0.7937568 though 0.793872 DCDACBDC 0.79379136 though0.79382592 DCDACBDCD 0.793812096 though 0.79382592 DCDACBDCDB0.7938134784 though 0.7938162432

After the entire message is processed, the final range produced is0.7938134784 though 0.7938162432. By using the single number0.7938134784, the entire message is represented.

Decoding is accomplished by reversing the process. Again, theprobabilities of the symbols in the message are known in advance. Then,the number is examined. Since it falls between 0.6 and 1.0, the firstcharacter of the message is “D.” The low value for the range of thedetermined character (0.6) is then subtracted from the encoded value,resulting in the value 0.1938134784. This value is then divided by thesize of the range for the determined character (0.4), which produces0.484533696. Since the new value falls between 0.3 and 0.6, the nextcharacter of the message is “C.” The low value for the range for thecharacter “C” (0.3) can be subtracted, resulting in 0.184533696, andthis can be divided by the size of the range for the character “C”(0.3), which produces 0.61511232. This process can be repeated, untilall the characters of the message have been identified. Table 2 showsthe complete message as it is decoded. TABLE 2 Encoded Value Message0.7938134784 D 0.484533696 DC 0.61511232 DCD 0.0377808 DCDA 0.377808DCDAC 0.25936 DCDACB 0.7968 DCDACBD 0.492 DCDACBDC 0.64 DCDACBDCD 0.1DCDACBDCDB

The reader may wonder how this compresses the message, since 10characters were needed to represent the encoding. This is explained bythe fact that there are very few characters in the message. A longermessage would show that the encoded message is shorter than the originalmessage.

The above example shows how a message can be encoded using staticprobability values. As pointed out, it was assumed that theprobabilities of the individual symbols in the message were known inadvance.

When dynamic probability values are used in the present inventionenabling single pass compression, this assumption can be discarded. Someinitial probability values are assigned to each symbol. One possibilityis that each symbol is equally likely. In the preferred embodiment ofthe invention, certain symbols (symbols that match either their left orupper neighbors) are considered more likely than others. Then, assymbols are encountered, the probability values for the symbols aredynamically updated to reflect the changing probabilities.

For example, consider again the message “DCDACBDCDB” above. Initially,each of the four symbols “A,” “B,” “C,” and “D” can be assigned the sameprobability of 25%. This can be accomplished in many ways: for example,it can be preliminarily assumed that each symbol was encountered oncefor purposes of defining the initial probabilities. Then, as the symbolsare encountered, the counts for the symbols can be updated. So, afterthe first symbol (“D”) is encountered, its probability value can beupdated to 40% (2 out of 5), with each of the other symbols reduced to20% (1 out of 5). After the next symbol (“C”) is encountered, theprobability values for symbols “A” and “B” reduces to 16.67% (1 out of 6for each), and the probability values for symbols “C” and “D” arechanged to 33.33% (2 out of 6 for each). And so on.

Using dynamic probability values improves the speed of the encodingtechnique. To compute the static probability values requires eitherselecting random probability values that may have no bearing on theactual message, or scanning the message to determine the probabilityvalues of the individual symbols in the message. Selecting randomprobability values can result in poor encoding; scanning the messagerequires performing two passes over the message (one to determine theprobability values, and one to encode the message). With dynamicprobability values, both disadvantages are avoided. The probabilityvalues become accurate for the message, but only one pass is needed overthe message (both to encode the message and to update the dynamicprobability values).

FIG. 7 shows the procedure used to divide the image of FIG. 2 into boxesfor compression on the computer system of FIG. 1A. At step 705, abackground color is determined for the image. This is usually done byanalyzing the colors of the pixels on the border of the image. At step710 the image is divided into blocks. As described above with referenceto FIG. 4A, in the preferred embodiment rectangular blocks are used. Butany tessellation (division of the plane) can be used, provided that nopixel is included in more than one block, and that each pixel with acolor different from the background color is included in a block. Steps715 and 720 are applicable only for animated images that includemultiple frames. Step 715 computes the distance frame between two framesin the animated image, and step 720 computes tessellations of thedistance frame. In both steps 710 and 720, multiple tessellations can beconsidered to find a tessellation that results in the smallestcompressed image size. Once multiple tessellations have been analyzed,at step 725 the tessellation that results in the smallest compressedfile size is selected, and then each block in the tessellation iscompressed. Note that only the blocks need to be compressed: theremaining pixels include only the background color, which can be veryeasily identified.

FIG. 8 shows a structure for compressed image file 175 according to thepreferred embodiment of the invention. In FIG. 8, the structure used forstoring and for transmitting compressed image file 175 begins withpreliminary information 805. Preliminary information 805 is sent onceper image, and specifies the size of the image (typically in two pixeldimensions: for example, 640×480), the color palette (typically as atable or a list of indices to color values), and the background color ofthe image (typically as an index into the color palette). Next comesblock information 810. Block information 810 specifies the location,size, and contents of a particular block in the compressed image file.The contents of the block are the compressed indices into the colorpalette for each pixel in the block. (In the preferred embodiment,pixels in each block are examined row by row, from the top of the blockto the bottom, and within each row from left to right. However, a personskilled in the art will recognize that pixels can be scanned in otherorders as well.) For example, referring back to FIG. 4A, blockinformation 810 can specify the location, size, and contents of box 415.Block information 810 can be repeated if there are multiple blocks inthe image.

If the image is an animated image, then frame information 815 can beprovided. Frame information 815 specifies the type of frame (forexample, the frame can be completely redrawn without reference to theprior frame, or the frame can be a distance frame, as described above)and the information about the frame. The information about the frame caninclude one or more blocks, as described above. Preliminary informationneed not be resent until the next image. However, a person skilled inthe art will recognize that some preliminary information (for example, anew color palette) can be sent, if desired.

Note that in nowhere in FIG. 8 is the structure of compressed image file175 described as including the model(s) used in compression. The reasonthe models are not included in compressed image file 175 is that themodels do not need to be stored. Instead, the models can bereconstructed as compressed image file 175 is read. For example, if whenthe image is compressed a particular pixel has the same color as itsleft and upper neighbors, the index into the color palette stored in thecompressed image file will reflect this. Thus, the models can bereconstructed when compressed image file 175 is read, and do not need tobe stored in compressed image file 175. This is an advantage overHuffman codes, which must be stored with the image file.

FIGS. 9A and 9B show the procedure used to decompress compressed imagefile 175 of FIG. 2 on the computer system of FIG. 1A. At step 905 (FIG.9A), the probability value for the current pixel is decoded. At step910, the probability value is analyzed to determine whether the color ofthe current pixel is supposed to be the same as either the left or upperneighbor of the current pixel. If the current pixel is the same color aseither the left or upper neighbor of the current pixel, then at step 915the color of the current pixel is copied from the left or upperneighbor, as appropriate, of the current pixel. Otherwise, at step 920,the color of the current pixel is decoded from the compressed imagefile. At step 925 (FIG. 9B), the probability model is updated, and ifnecessary, at step 930 a new probability model is selected. Then, ifmore pixels remain to be decoded, the process returns to step 905.Otherwise, at step 935, the decompressed image is displayed.

Regarding step 930, as discussed above with reference to FIG. 3, the useof different probability models helps to improve the compression byfocusing each probability model on a different probability value. Forexample, consider probability model 305, and assume that the currentpixel and its left and upper neighbors have the same color. Because thecurrent pixel had the same color as its left and upper neighbors, thecompression technique expects that the next pixel will have the samecolor as its left and upper neighbors. If this expectation is satisfied,probability value 305-1 will be further increased, as opposed to any ofprobability values 305-2, 305-3, 305-4, and 305-5. In range coding, thebigger the available range, the fewer the number of bits necessary tocompress the message. Thus, by focusing each probability model on adifferent combination of the colors of the current pixel and its leftand upper neighbors, the probability models are able to compress theimage using fewer bits, resulting in better compression than wouldotherwise occur.

The decompressor is able to decompress compressed image file 175 withoutreading the probability models from compressed image file 175 becausethe decompressor is able to recreate the probability models on the fly.Like the compressor, the decompressor starts with initial probabilitymodels, the same as shown in FIG. 3. As the decompressor reads thecompressed information from compressed image file 175, it can update theprobability models in the same way as the compressor did when thecompressor compressed image file 130. In this way, thecompressor/decompressor resembles Lempel-Ziv compression. In theLempel-Ziv compression, the compressor and decompressor builddictionaries as the file is read for compression/decompression. Althoughthe instant invention does not use a dictionary, the probability modelscan be built by both the compressor and decompressor as they read theimage file and the compressed file, respectively.

A person skilled in the art will recognize that the method and apparatusfor compression described herein provides for lossless compression. Thatis, the image file is compressed with no loss of information. Whencompressed image file 175 is decompressed, the resulting file containsthe same information as was in image file 130, before the compressionoccurred.

Appendix A shows an implementation of the compression algorithmdescribed herein. In Appendix A, the comments describe a preferredembodiment of the algorithm implemented in the source code. The commentsin Appendix A can be thought of as pseudo-code. Although exemplary, aperson skilled in the art will recognize that other implementations andvariations on the implementation shown are possible.

Having illustrated and described the principles of our invention in anembodiment thereof, it should be readily apparent to those skilled inthe art that the invention can be modified in arrangement and detailwithout departing from such principles. We claim all modificationscoming within the spirit and scope of the accompanying claims.

1. A method for compressing an indexed color image on a computer, themethod comprising: identifying a pixel color for a pixel; identifying aleft neighbor color for a left neighbor of the pixel; identifying anupper neighbor color for an upper neighbor of the pixel; comparing thepixel color with the left neighbor color and the upper neighbor color;selecting a probability model from a probability set, the probabilityset including at least two probability models, each probability modelincluding at least two probabilities for the pixel color; encoding thepixel color based on the comparison using the probability model; andupdating the probability model.
 2. A method according to claim 1, themethod further comprising encoding the left neighbor color for the leftneighbor of the pixel and the upper neighbor color for the upperneighbor of the pixel according to the probability model.
 3. A methodaccording to claim 1, wherein updating the model includes changing aprobability value regarding the relationship between the pixel color andthe left neighbor color and the upper neighbor color.
 4. A methodaccording to claim 1, wherein encoding the pixel color includes encodingthe pixel color based on the comparison using a probability value in theprobability model regarding the relationship between the pixel color andthe left neighbor color and the upper neighbor color.
 5. A methodaccording to claim 4, wherein encoding the pixel color further includesselecting one of a plurality of probability values in the probabilitymodel regarding the relationship between the pixel color and the leftneighbor color and the upper neighbor color.
 6. A method according toclaim 4, wherein encoding the pixel color further includes selecting anindex from a color palette according to the results of comparing thepixel color to the left neighbor color and the upper neighbor color. 7.A method according to claim 6, wherein encoding the pixel color furtherincludes compressing the selected index from the color palette.
 8. Amethod according to claim 4, wherein encoding the pixel color furtherincludes encoding the probability value.
 9. (Canceled)
 10. A method forcompressing an indexed color image on a computer, the method comprising:detecting a background color of the image; selecting a part of the imagethat includes a color other than the background color, the selected partof the image including at least two pixels; dividing the selected partof the image into at least two tessellations of blocks, eachtessellation of blocks including at least one block, wherein each blockincludes at least one pixel with a color other than the background colorand each pixel in the image with a color other than the background coloris included in exactly one block in each tessellation; estimating a sizefor each tessellation, wherein each block in each tessellation iscompressed separately; selecting a tessellation with a smallestestimated size; and compressing each block in the selected tessellationseparately.
 11. A method according to claim 10, wherein compressing theselected part of the image includes: locating at least one block in theimage that includes a pixel with a color other than the backgroundcolor; and compressing each block separately.
 12. A method according toclaim 10, wherein compressing the selected part of the image includesstoring a location, a size, and a color for the part of the image whenthe part of the image includes pixels with only a single color. 13.(Canceled)
 14. (Canceled)
 15. A method for decompressing an indexedcolor image on a computer, the method comprising: decoding a probabilityvalue for a compressed color for a pixel; selecting a probability modelfrom a probability set, the probability set including at least twoprobability models, each probability model including at least twoprobabilities for the pixel color; determining whether the probabilityvalue represents the same color as a left neighbor color for a leftneighbor of the pixel or an upper neighbor color for an upper neighborof the pixel using the probability model; decoding an uncompressed colorfor the pixel; and updating the probability model.
 16. A methodaccording to claim 15, wherein updating the model includes changing theprobability value in the probability model regarding the relationshipbetween the compressed color and the left neighbor color and the upperneighbor color.
 17. A method according to claim 15, wherein determiningwhether the probability value represents the same color includes usingthe probability value in the probability model regarding therelationship between the compressed color and the left neighbor colorand the upper neighbor color.
 18. A method according to claim 17,wherein using the probability value includes selecting one of aplurality of probability values regarding the relationship between thecompressed color and the left neighbor color and the upper neighborcolor.
 19. A method according to claim 15, wherein decoding anuncompressed color includes selecting an index from a color paletteaccording to whether the compressed color represents the same color asthe left neighbor color or the upper neighbor color.
 20. A methodaccording to claim 19, wherein selecting an index from a color paletteincludes decoding the selected index when the compressed color isdetermined to be different from the left neighbor color and the upperneighbor color.
 21. (Canceled)
 22. A computer-readable medium containinga program to compress an indexed color image on a computer, the programcomprising: identification software to identify a pixel color for apixel; identification software to identify a left neighbor color for aleft neighbor of the pixel; identification software to identify an upperneighbor color for an upper neighbor of the pixel; comparison softwareto compare the pixel color with the left neighbor color and the upperneighbor color; selection software to select a probability model from aprobability set, the probability set including at least two probabilitymodels, each probability model including at least two probabilities forthe pixel color; encoding software to encode the pixel color based onthe comparison using the probability model; and updating software toupdate the probability model.
 23. A computer-readable medium containinga program according to claim 22, wherein the updating software includeschanging software to change a probability value regarding therelationship between the pixel color and the left neighbor color and theupper neighbor color.
 24. A computer-readable medium containing aprogram according to claim 22, wherein the encoding software includesselection software to select one of a plurality of probability values inthe probability model regarding the relationship between the pixel colorand the left neighbor color and the upper neighbor color.
 25. Acomputer-readable medium containing a program according to claim 22, theprogram designed to store the compressed indexed color image in a datastructure in memory, the data structure including: dimensions for theimage; a color palette for the image; a background color of the image;and at least one compressed block, the compressed block including alocation for the block, dimensions for the block, and at least one pixelcompressed using a dynamic probability model.
 26. (Canceled)
 27. Acomputer-readable medium containing a program to compress an indexedcolor image on a computer, the program comprising: detection software todetect a background color of the image; selection software to select apart of the image that includes a color other than the background color,the selected part of the image including at least two pixels; divisionsoftware to divide the selected part of the image into at least twotessellations of blocks, each tessellation of blocks including at leastone block, wherein each block in each tessellation includes at least onepixel with a color other than the background color and each pixel in theimage with a color other than the background color is included inexactly one block in each tessellation; estimation software to estimatea size for each tessellation, wherein each block in each tessellation iscompressed separately; selection software to select a tessellation witha smallest estimated size; and compression software to compress eachblock in the selected tessellation separately.
 28. (Canceled) 29.(Canceled)
 30. A computer-readable medium containing a program accordingto claim 27, the program designed to store the compressed indexed colorimage including at least two frames in a data structure in memory, thedata structure including: dimensions for the image; a color palette forthe image; a background color of the image; at least one compressedblock, the compressed block including a location for the block,dimensions for the block, and at least one pixel compressed using adynamic probability model; and a frame marker indicating whether or notone of the frames is a distance frame.
 31. A computer-readable mediumcontaining a program to decompress an indexed color image on a computer,the program comprising: decoding software to decode a probability valuefor a compressed color for a pixel; selection software to select aprobability model from a probability set, the probability set includingat least two probability models, each probability model including atleast two probabilities for the pixel color; determination software todetermine whether the probability value represents the same color as aleft neighbor color for a left neighbor of the pixel or an upperneighbor color for an upper neighbor of the pixel using the probabilitymodel; decoding software to decode an uncompressed color for the pixel;and updating software to update the probability model.
 32. Acomputer-readable medium containing a program according to claim 31,wherein the updating software includes changing software to change theprobability value in the probability model regarding the relationshipbetween the compressed color and the left neighbor color and the upperneighbor color.
 33. A computer-readable medium containing a programaccording to claim 31, wherein the determination software includesmodeling software operable in accordance with the probability model touse the probability value in the probability model regarding therelationship between the compressed color and the left neighbor colorand the upper neighbor color.
 34. A computer-readable medium containinga program according to claim 31, wherein the decoding software includesselection software to select an index from a color palette according towhether the compressed color represents the same color as the leftneighbor color or the upper neighbor color.
 35. A computer-readablemedium containing a program according to claim 34, wherein the selectionsoftware includes decoding software to decode the selected index whenthe compressed color is determined to be different from the leftneighbor color and the upper neighbor color.
 36. An apparatuscomprising: a computer including a processor and a memory; an indexedcolor image loaded in the memory of the computer; a color palettespecifying colors in the image; a probability set, including at leasttwo probability models, each probability model including at least twoprobability values for a color of a pixel given a color of a leftneighbor of the pixel and a color of an upper neighbor of the pixel;selection means to select the probability model from the probabilityset; an update module designed to update the probability value in theprobability model given the color of the pixel, the color of the leftneighbor of the pixel, and the color of the upper neighbor of the pixel;and a compressor designed to compress the color of the pixel using thecolor palette.
 37. An apparatus according to claim 36, wherein: theimage includes a first frame and a second frame; and the apparatusfurther comprises a distance frame generator for generating a distanceframe between the first and second frames of the image.
 38. An apparatusaccording to claim 36, wherein: the image includes a background color;and the apparatus further comprising a block locator for locating ablock in the image, the block including at least one pixel with a colorother than the background color and at least a second pixel.
 39. Anapparatus according to claim 36, the apparatus further comprising a sizeestimator designed to estimate the size of the compressed image using adivision of the image.
 40. (Canceled)
 41. (Canceled)
 42. An apparatusaccording to claim 36, the apparatus further comprising decompressionmeans for decompressing a compressed image compressed on the computer.43. An apparatus according to claim 42, wherein: the decompression meansare operable on a second computer; and the apparatus further comprisestransmission means for transmitting the compressed image from thecomputer to the second computer.
 44. (Canceled)
 45. A memory for storinga compressed image file for access by an application program beingexecuted on a computer, comprising: a data structure stored in saidmemory, said data structure including: dimensions for the image; a colorpalette for the image; a background color of the image; and at least onecompressed block, the compressed block including a location for theblock, dimensions for the block, and at least one pixel compressed usinga dynamic probability model, the compressed block including a subset ofpixels in the image which consists of less than all pixels in the image.46. A memory according to claim 45, wherein: the image includes at leasttwo frames; and the data structure further includes a frame markerindicating whether or not one of the frames is a distance frame.
 47. Amethod for compressing an indexed color image on a computer, the methodcomprising: detecting a background color of the image; selecting a partof the image that includes a color other than the background color;dividing the image into at least two tessellations of blocks, eachtessellation of blocks including at least one block, wherein each blockincludes at least one pixel with a color other than the background colorand each pixel in the image with a color other than the background coloris included in exactly one block in each tessellation; estimating a sizefor each tessellation, wherein each block in each tessellation iscompressed separately; computing a distance frame between a first frameand a second frame of the image; dividing the distance frame into atleast two tessellations of blocks, each tessellation of blocks includingat least one block, wherein each block includes at least one pixel witha color other than the background color and each pixel in the distanceframe with a color other than the background color is included inexactly one block in each tessellation; estimating a size for eachtessellation of the distance frame, wherein each block in eachtessellation is compressed separately; selecting a tessellation from thetessellations of the image and the tessellations of the distance framewith a smallest estimated size; and compressing each block in theselected tessellation separately.
 48. A computer-readable mediumcontaining a program to compress an indexed color image on a computer,the program comprising: detection software to detect a background colorof the image; selection software to select a part of the image thatincludes a color other than the background color; division software todivide the image into at least two tessellations of blocks, eachtessellation of blocks including at least one block, wherein each blockincludes at least one pixel with a color other than the background colorand each pixel in the image with a color other than the background coloris included in exactly one block in each tessellation; estimationsoftware to estimate a size for each tessellation, wherein each block ineach tessellation is compressed separately; distance computing softwareto compute a distance frame between a first frame and a second frame ofthe image; division software to divide the distance frame into at leasttwo tessellations of blocks, each tessellation of blocks including atleast one block, wherein each block includes at least one pixel with acolor other than the background color and each pixel in the distanceframe with a color other than the background color is included inexactly one block in each tessellation; estimation software to estimatea size for each tessellation of the distance frame, wherein each blockin each tessellation is compressed separately; selection software toselect a tessellation from the tessellations of the image and thetessellations of the distance frame with a smallest estimated size; andcompression software to compress each block in the selected tessellationseparately.
 49. An apparatus comprising: a computer including aprocessor and a memory; an indexed color image loaded in the memory ofthe computer; a color palette specifying colors in the image; aprobability model predicting a probability value of a color of a pixelgiven a color of a left neighbor of the pixel and a color of an upperneighbor of the pixel; an update module designed to update theprobability value in the probability model given the color of the pixel,the color of the left neighbor of the pixel, and the color of the upperneighbor of the pixel; a size estimator designed to estimate the size ofthe compressed image using a division of the image; selection means toselect a division of the image based on the estimated size of aplurality of divisions of the image; and a compressor designed tocompress the color of the pixel using the color palette.
 50. Anapparatus according to claim 49, wherein the selection means is furtherdesigned to select the division of the image based on the estimated sizeof the plurality of divisions of the image and the estimated size of aplurality of divisions of a distance frame between a first frame and asecond frame of the image.